The Control of the False Discovery Rate in Fixed Sequence Multiple Testing
نویسندگان
چکیده
Controlling the false discovery rate (FDR) is a powerful approach to multiple testing. In many applications, the tested hypotheses have an inherent hierarchical structure. In this paper, we focus on the fixed sequence structure where the testing order of the hypotheses has been strictly specified in advance. We are motivated to study such a structure, since it is the most basic of hierarchical structures, yet it is often seen in real applications such as statistical process control and streaming data analysis. We first consider a conventional fixed sequence method that stops testing once an acceptance occurs, and develop such a method controlling the FDR under both arbitrary and negative dependencies. The method under arbitrary dependency is shown to be unimprovable without losing control of the FDR and unlike existing FDR methods; it cannot be improved even by restricting to the usual positive regression dependence on subset (PRDS) condition. To account for any potential mistakes in the ordering of the tests, we extend the conventional fixed sequence method to one that allows more but a given number of acceptances. Simulation studies show that the proposed procedures can be powerful alternatives to existing FDR controlling procedures. The proposed procedures are illustrated through a real data set from a microarray experiment. AMS 2000 subject classifications: Primary 62J15
منابع مشابه
The False Discovery Rate in Simultaneous Fisher and Adjusted Permutation Hypothesis Testing on Microarray Data
Background and Objectives: In recent years, new technologies have led to produce a large amount of data and in the field of biology, microarray technology has also dramatically developed. Meanwhile, the Fisher test is used to compare the control group with two or more experimental groups and also to detect the differentially expressed genes. In this study, the false discovery rate was investiga...
متن کاملStepup Procedures for Control of Generalizations of the Familywise Error Rate
Consider the multiple testing problem of testing null hypotheses H1, . . . ,Hs. A classical approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate (FWER), the probability of even one false rejection. But if s is large, control of the FWER is so stringent that the ability of a procedure that controls the FWER to detect fals...
متن کاملMultiple hypothesis testing using the excess discovery count and alpha-investing rules
We propose an adaptive, sequential methodology for testing multiple hypotheses. Our methodology consists of a new criterion, the excess discovery count (EDC), and a new class of testing procedures that we call alpha-investing rules. The excess discovery count is the difference between the number of correctly rejected null hypotheses and a fraction of the total number of rejected hypotheses. EDC...
متن کاملA New Proof of FDR Control Based on Forward Filtration
For multiple testing problems, Benjamini and Hochberg (1995) proposed the false discovery rate (FDR) as an alternative to the family-wise error rate (FWER). Since then, researchers have provided many proofs to control the FDR under different assumptions. Storey et al. (2004) showed that the rejection threshold of a BH step-up procedure is a stopping time with respect to the reverse filtration g...
متن کاملOptimal likelihood-ratio multiple testing with application to Alzheimer’s disease and questionable dementia
BACKGROUND Controlling the false discovery rate is important when testing multiple hypotheses. To enhance the detection capability of a false discovery rate control test, we applied the likelihood ratio-based multiple testing method in neuroimage data and compared the performance with the existing methods. METHODS We analysed the performance of the likelihood ratio-based false discovery rate ...
متن کامل